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O 1 INTRODUCTION 

. !-H ' The frame selection technique for high resolution imaging 
■ involves the recording of a time series of short exposure im- 
5^ ' ages and the selection of the sharpest images out of the 
series for alignment and combining into a final image. iFriedl 
1 19781 ) determined that the probability of obtaining a lucky 
sharp image (defined as one with wavefront variance less 
than Irad^) with a telescope of aperture D in seeing de- 
scribed by a Fried parameter ro (|Friedlll967l ) is given by: 



ABSTRACT 

We present an empirical analysis of the effectiveness of frame selection (also known as 
Lucky Imaging) techniques for high resolution imaging. A high-speed image recording 
system has been used to observe a number of bright stars. The observations were made 
over a wide range of values of D/vq and exposure time. The improvement in Strehl 
ratio of the stellar images due to aligning frames and selecting the best frames was 
evaluated as a function of these parameters. We find that improvement in Strehl ratio 
by factors of 4 to 6 can be achieved over a range of D/rg from 3 to 12, with a slight 
peak at D/rQ ^ 7. The best Strehl improvement is achieved with exposure times of 
10 ms or less but significant improvement is still obtained at exposure times as long 
as 640 ms. Our results are consistent with previous investigations but cover a much 
wider range of parameter space. We show that Strehl ratios of >0.7 can be achieved 
in appropiate conditions whereas previous studies have generally shown maximum 
Strehl ratios of ^0.3. The re s ults a re in reasonable agreement with the simulations of 
[Baldwin. Warner fc Mackavl (|2008D . 
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P = 5.6exp[~0.1557{D/ro)] 



(1) 



This suggests that there will be more good quality im- 
ages available at low D/vq. The probability of such an image 
is 1 in 9 for D/ro = 5 or 1 in 50 for D/tq = 6. For higher 
D/ro the probability of a sharp image rapidly decreases, be- 
ing 1 in 3800 for D/ro =8. Since the image quality gain will 
increase with D/tq this suggests the frame selection techique 
will work best for D/ro ~ 6 — 7, this being the largest D/ro 
at which there is a good chance of finding several high qual- 
ity images in a typical image sequence of a few thousand 
frames. 
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There have been a number of practical demon- 
strations o f this technique vari o usly d escribed as frame 
selection (iRoggemann fc WelshI Il996h . lucky imaging 
(Law et al. 2006), or selective i mage reconst r uction 
(D anto witz, Tear c fcKozuball [2OO0I ) . [Baldwin et"aLl (|200ll ) 
demonstrated the ability to obtain diffraction limited star 
images at SOOnm wavelength with a 2.5m telescope. 

The technique has been used to image the hemi- 
sphere of Mercury that was missed by Mariner 10 
(iDantowitz. Teare fc Kozuballl2000l : ICecil fc Rashkeevl2o"07l : 
iKsanfomalitv fc Spragud 2007 ) and is now widely used by 
amateur astronomers for planetary imaging. 

Interest in the technique is rapidly increasing, in part 
due to the availability of electron multiplying CCD (EM- 
CCD) technology, which allows rapid readou t of CCDs 
with negligible read noise l|Mackav et al.|[200ll ). as well as 
computers with fast processors and large storage capac- 
ity. A number of such systems have recently be en demon- 
strated, for example L uckyCam llLaw et al.ll2006l), Astra Lux 
(|Hormuth et al.ll2008 !) and FastCam (|Oscoz et al lboOSi ). 

However, previous studies have generally been aimed 
at obtaining the best possible image resolution and have 
therefore explored a restricted range of parameters. In this 
paper we present observations that explore a wide range of 
parameter space. We have explored empirically the effects of 
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telescope aperture D, wavelength A, frame exposure time t 
and frame selection rate FSR on the resulting image quality. 
Unlike most previous studies which have aimed at exploiting 
excellent seeing conditions, our observations were obtained 
in a range of seeing conditions from good to poor. The results 
provide information that can help to optimize the design of 
future instruments. 



2 OBSERVATIONS 

The observations were obtained using MUSIC Mk I (Mac- 
quarie University Selective Imaging Camera) . The study was 
carried out as a preliminary stage in the design of a more 
advanced lucky imaging system that will use an electron 
multiplying CCD camera. The imager used for MUSIC was 
a Watec lOON monochrome video camera. This camera was 
chosen because it had adjustable exposure times and ade- 
quate sensitivity to observe bright stars. The observations 
used standard BVRI filters. The camera was placed either 
directly at the telescope focus, or when necessary used with 
a 2.5 times focal extender. In all cases the image scale was 
chosen to ensure that the pixels provided good sampling of 
diffraction limited star images. 

The camera produces video output with an effective 
pixel size of 8.6 by 8.3 /im and a format of 768 by 576 pix- 
els. The camera generates video data with interlaced scan- 
ning (i.e. each frame consists of consecutive scans of odd 
rows and even rows stitched together). The video data was 
recorded using a Data Translation DT3155 PCI frame grab- 
ber mounted in a PC system using a 3GHz Pentium 4 pro- 
cessor. The PC was configured with 1 TB of disk space (two 
400 Gb and one 200 GB drives) to record the large data files. 
The operating system was Fedora Core Linux. A data acqui- 
sition software system was developed that enabled data from 
the video camera to be recorded continuously as three di- 
mensional FITS files, while being displayed in real time. The 
software made use of C-f-l- classes developed at the Anglo- 
Australian Observa tory for the IRIS 2 project and AA02 
detector controllers (|Shortridge et al.L2004 l. The image dis- 
play was based on the ESQ Real Time D isplay (RTD) sys- 
tem l|Herlin. Brighton fc Biereichell [T996I ) . The system was 
capable of recording full frame video data to disk for ex- 
tended periods. Typical observations consisted of sequences 
of 3000 to 10000 video frames. 

MUSIC was used on three telescopes. The observing 
dates, locations and instruments used are summarised in 
table [T] The bulk of the observations were obtained on the 
Im ANU telescope at Siding Spring Observatory. A small 
number of observations were obtained on the 3.9m Anglo- 
Australian Telescope (AAT, also at Siding Spring) and on 
the 0.4m telescope of the Macquarie University Observatory 
in Sydney. 

One aim of the observations was to explore the effects 
of changes in -D/ro, which may be regarded as the seeeing- 
normalised aperture. While natural variation in seeing pro- 
vides changes in ro, we also varied D by placing masks of 
different size over the telescope aperture. With the Im tele- 
scope we used mask sizes of 75cm, 30cm, 20cm and 10cm, 
with the smaller masks being placed off-centre to avoid the 
central obstruction of the secondary mirror. With the AAT 
off-centre masks corresponding to apertures from 40cm to 



Table 1. Summary of MUSIC Observing Runs 



Date 


Location 


Instrument 


2005 Mar 8 


Macquarie University, 


Meade 40cm 




Sydney NSW 




2005 Mar 11-23 


Siding Spring, NSW 


ANU Im 


2005 Jun 25 


Siding Spring, NSW 


AAT 3.9m 


2005 Nov 9-14 


Siding Spring, NSW 


ANU Im 



1.0m were used located at the top of the "chimney" above 
the primary mirror central hole. A 2.5m aperture was also 
achieved by closing down the primary mirror covers. 

The frame exposure times used ranged from 1 — 20ms on 
the camera. Additional runs with exposure times from 40 — 
640ms were simulated by combining groups of consecutive 
frames from the 20ms runs. 

Observations were made of a number of bright stars, 
as well as of some clusters and binaries of various angu- 
lar separations to test the effects of selective imaging on 
image sharpness across the field. In each case observations 
were recorded with a range of different exposure times, and 
through different filters. 

Frames in each FITS cube were calibrated by bias sub- 
traction and flat flelding (using exposures of the daylight 
sky). With our camera, the odd and even rows in each in- 
terlaced scan represent two consecitive exposures. Therefore 
each frame was de-interlaced by separating the odd and even 
rows into separate frames and filling the gaps by interpola- 
tion. This produced calibrated FITS cubes with twice as 
many frames as the raw ones. Also, in order to maintain 
precision the new data cubes were saved in fioating point 
format. 

W e used a simple peak pixel algorithm l|Aspin et al.l 
Il997f ) for aligning and selecting frames. This relies on the 
fact that noise in the image is minimal, which is generally 
the case for the bright stars oberved. Different techniques 
would be needed for fainter guide stars. We therefore use the 
value of the highest pixel in each frame as a measure of im- 
age quality, since sharper stellar images will have more flux 
in the central peak. Post-processing was done by scanning 
each cube to find the brightest pixel in each frame, and then 
the frames were ranked in order of peak pixel value. The de- 
sired fraction of best frames, defined by the frame selection 
rate {FSR), were aligned so that the position of the peak 
pixel in each frame coincided with that in the best frame 
and then average-combined ("shift-and-added"). Frame se- 
lection rates of 100%, 10% and 1% were used. These were 
compared with simulated long exposures made by combining 
all frames with no alignment ("stacking"). 

We used the Strehl ratio as a measure of the quality of 
the resulting star images. Another possible measure is the 
full width at half maximum (FWHM) of the image. How- 
ever, this is not, in practice, a good measure of image qual- 
ity. Images resulting from frame selection generally have a 
core-halo structure; i.e. a diffraction limited core surrounded 
by an extended halo the size of the original seeing disk. The 
core can give rise to a small FWHM even though most of the 
energy is in the halo. Strehl ratio is a much more demanding 
measure of image quality, since a high Strehl ratio can only 



be achieved if most of the energy is in the diffraction lim- 
ited core. We measured the Strehl ratios using th e "strehl" 
comm and of the ESO Eclipse software package ijDevillardl 
l200j ). This works by comparing the observed images with 
a simulated diffraction-limited point spread function, which 
takes into account, where appropriate, the central obstruc- 
tion of the aperture in a Cassegrain telescope. 



3 DISCUSSION 

3.1 Frame Selection Rate FSR 

The stellar images produced by frame selection shown in fig- 
ure[T]are among our best results. Note that the images in the 
top row are displayed brightness-normalised and logarith- 
mic pixel scale to highlight faint features. In figure [2a) the 
frames were stacked, simulating a long exposure image. The 
next image has all frames shift- and- added {FSR = 100%), 
which is equivalent to tilt correction. The binary is well re- 
solved with a separation of 1.7 arcseconds that matches pub- 
lished values. Both stars have a clear central peak with a 
significant halo. The third and fourth images have the best 
10% and 1% of frames aligned and combined. This removed 
those frames with the greatest speckling caused by high or- 
der wavefront distortions. The result is greater flux in the 
central peak and a fainter halo. In the 1% FSR image there 
is a dark ring at a radius of 8 pixels from each peak, matching 
the Rayleigh criterion for a diffraction limited image. The 
3-dimensional plots show the diminishing halo and increas- 
ing brightness of the peaks with decreasing FSR, which is 
not shown by the brightness-normalised images. The Strehl 
ratios for both peaks in each frame-selected image listed in 
table[2]verify the quality improvement, with the FSR — 1% 
image having a Strehl raio of almost 0.8. 

The Strehl ratios listed in table [5] illustrate an impor- 
tant effect of shift-and-add processing. In the long exposure 
image the two peaks are unresolved so no Strehl ratio mea- 
surement is possible. In each of the frame selected images 
the Strehl ratio of the secondary peak is higher than that 
in the long exposure, but in all cases is less than the cor- 
responding primary peak. This is because even frames with 
high overall sharpness may still contain more than one iso- 
planatic patch. When frames are co-aligned on the brightest 
pixel the Strehl ratio of the primary peak is artificially en- 
hanced. Other peaks may have a different tilt and speckle 
pattern. Shift-and-adding may still improve the sharpness of 
these features, but to a lesser extent than the primary peak, 
as seen in figure [T] and table (2] Our data shows a general 
trend to diminishing Strehl ratio and less Strehl improve- 
ment with increasing angular distance from the alignment 
location. This trend seems to be largely independent of FSR 
and D/ rp. This is i n qualitative agreement with the simula- 
tions bv lBaldwin. W arner & Mackay ( 2008), though a direct 
quantitative comparison is not possible. However in all of 
our observations the secondary peaks showed improvement 
with frame selection, even over angular separations as large 
as 100 arcseconds. 
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Table 2. Strehl ratios of peaks in images in figure [T] 





Frame Selection Rate 


Peak 


100% 


10% 1% 


Primary 


0.517 


0.654 0.799 


Secondary 


0.362 


0.547 0.674 


Secondary /Primary 


69.9% 


83.7% 84.4% 



3.2 Seeing-normalised aperture D/ro 

We determined ro from the FWHM of the long exposure 
image using the standard relationship FWHM — 0.98A/ro. 
Over all of our observations ro ranged from 1 to 12cm, and 
D/ro from 2.8 to 30.3. Figure [2] plots bin-averaged Strehl 
ratios of stellar image versus D/ro between 3.0 and 12.0. 
For D/ro > 12.0 the trends continue more or less flat. For 
D/ro < 12.0 the obvious trend is for higher Strehl ratios in 
better seeing (large ro) and/or with smaller aperture (small 
D). With low D/ro, not only are there more good frames 
to choose from (one could use a quality threshold instead of 
frame selection rate) but the average frame quality is bet- 
ter, as indicated by higher Strehl ratios of the long exposure 
images in this region. This makes frame selection most suit- 
able for use with small to medium sized telescopes at visible 
wavelengths. This does, however, limit the magnitudes of 
usable target objects or guide stars. 

Figure [3] shows the quality improvement versus D/ro- 
The improvement factor was measured by the gain in the 
Strehl ratio; that is, the Strehl ratio of a frame selected 
image divided by that of the long exposure image derived 
from the same image cube. Figure [3] compares the improve- 
ment made by pure shift-and-add (100%-FS'J?) with that 
from 1%FSR. The VYoFSR points are consistently higher 
than those for 1QQ%FSR, confirming the advantage of being 
more selective. The 1%FSR images show an improvement 
factor greater than 5 for D/ro between 4.5 and 7.8, with a 
small peak at D/ro ~ 7. This represents the best compro- 
mise between the diffraction-limited resolution, which im- 
proves with increasing D, and seeing-limited resolution that 
improves with increasing tq. Nevertheless the peak is not 
very pronounced, and substantial Strehl ratio improvement 
is obtained at all values of D/ro- 

Data from our individual observations is displayed in 
figure [4] compared with results from other experiments. In 
this plot our data are limited to i ^ 4ms and D/ro ^ 12, 1% 
and 1 00%FSR. The cross e s are previous lucky imaging re- 
suhs l|Baldwin et al.ll200ll : iLaw et al.ll2006l : iHormuth et all 
|2008| ) and match our data well, even though our data was 
generally obtained in poorer seeing but with smaller aper- 
tures. However, these previous studies generally targeted the 
optimum case of D/ro ~ 7, and acheved maximum Strehl 
ratios of ~ 0.3. Our data show that smaller D/ro values can 
be used to achieve higher strehl ratios of > 0.6 and in a few 
cases as high as 0.8. The high Strehl ratios for the images 

in figure [1] were achieved with D/ro — 3.84. 

The line in figure|4]is the simulation from I Baldwin et al.l 

(j2008h . It can be seen that the simulation line lies at the up- 
per boundary of the scatter of points. Typically both our ob- 
servations and previous results lie below the simulation. This 
is probably due to aberrations in the optics of the telescopes 
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(a) Long exposure. (b) FSR=\mVo. 



{c)FSR=10%. 



id)FSR=l%. 



Figure 1. Images of binary star rOpliiuchii (1.7" separation) produced by selective imaging. Images in the top row are brightness- 
normalised and logarithmic pixel scale to highlight the faint halo. The 3-dimensional plots in the bottom row are linear scale, and show 
increasing peaks with decreasing FSR. Images were taken on the AAT, D = 40cm aperture mask, t = 120ms, A = 0.7fj,m filter. 



Table 3. Ranges of ro, D/ro and long exposure Strehl ratios 
measured in the V and I bands. 





'■o( 


cm) 


D/ro 


Long exp. 
Strehl ratios 


Band 


V 


I 


V I 


V I 


max 
min 


7.3 
1.2 


12.2 
2.1 


25.90 22.72 
4.64 2.89 


0.107 0.161 
0.008 0.008 



employed. The simulated case assumes a diffraction limited 
telescope. In this case frame selection will select those im- 
ages in which the wavefront distortion due to turbulence is 
minimal. When using a real telescope with aberrations it is 
necessary instead to select those frames in which the turbu- 
lence induced wavefront distortions cancel out those due to 
telescope aberrations. The probability of a "lucky image" in 
this case i s lower than that for a pe rfect difraction limited 
telescope ([Beckers fc Rimmeld llQOil ) and hence the image 
quality gain from frame selection is reduced. 



3.3 Colour band A 

Because ro oc A®^^ ijFriedl [T966l l it was expected that the 
better Strehl ratios would be achieved at longer wavelengths 
due to the larger ro patch. Table |3] shows the ranges of ro, 
D/ro and long exposure (stacked) Strehl ratios measured 
from our obseravtions in the V-band (0.55 /xm) and I-band 
(0.80 fim). Because of the lower range of D/ro in the I- 
band images their average frame quality was better than 
in other bands, giving higher average Strehl ratios in both 
the long exposures and the frame selected images. A smaller 
number of observations obtained in the B and R bands were 
consistent with this trend. 
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D/r„ 

Figure 2. Strehl ratio versus D/ro of stellar images binned in 
D/ro- Open circles are the results of selecting and aligning the 
best 1% of frames. Filled circles are the results of aligning all im- 
ages with no frame selection ("shift-and-add" processing). Stars 
are the results of summing frames with no shifts (i.e. giving the 
equivalent long exposure imago). 

3.4 Frame exposure time t 

To effectively freeze the turbulence the frame exposure time 
must be less than to ~ ro/w, where v is the bulk wind veloc- 
ity in the region responsible for the turbulence. However a 
small t limits the available targets to the brightest objects, 
and reduces the SNR of each frame. Thus it is crucial in 
frame selection to optimise t. 

The top panel of figure [5] shows Strehl ratios against 
exposure times for 1%FSR, with the data binned into four 
ranges of D/ro- The bottom panel plots the improvement 
in Strehl ratio over the stacked images. Even at the longest 
times tested (640ms) the Strehl ratios improved by a factor 
of 2. Shorter times gave greater improvement, but the curves 
appears to flatten below 8 to 10ms, especially for larger 
D/ro- Hence we find that, although selective imaging gives 
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Figure 3. As for figure[2] but plotting tiie improvement in strehl 
ratio compared with the long exposure image for each bin of D/tq. 
Open circles are the results of selecting and aligning the best 1% 
of frames. Filled circles are the results of aligning all images with 
no frame selection ( "shift-and-add" processing). 



0.6 



0.2 




Figure 4. Strehl ratio versus D/rg for individual observations 
with exposure time of 4 ms or less. Open circles are the result 
of selecting and aligning the best 1% of frames. Stars are the 
reult of summing all frames without alignment or selection giving 
the equivalent long e xposure image. The line is the prediction 
from the simulation of l Baldwin et all | |200^ . Crosses are previous 
lucky imaging results as described in the text. 



improved image quality for any reasonably short exposure 
time, if the target is sufficiently bright t should be limited to 
10ms. For our typical ro of about 5 cm this corresponds to 
a wind speed of 5 ms~^ . The ground wind speeds measured 
during the runs at Siding Spring were typically in the range 
3-8 ms~^ and therefore consistent with a significant amount 
of the seeing being generated near the ground. In better 
seeing or at longer wavelengths longer frame exposure times 
should be acceptable. 
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Figure 5. Strehl ratio (upper panel) and Strehl improvement 
factor (lower panel) for data processed by selection and alignment 
of the best 1% of frames as a function of exposure time. The data 
are binned into four different ranges of D/ro 



4 CONCLUSIONS 

Our analysis confirms previous results in showing that sub- 
stantial improvements in image Strehl ratio can be achieved 
by selecting and aligning the sharpest frames in a time series 
of short exposure images. By reducing the telescope aper- 
ture to be a few multiples of ro, thereby minimising D/ro, 
and by selecting only 1% of the best quality frames Strehl 
ratios as high as 0.6 to 0.8 were obtained. The improve- 
ment was greatest when imaging at longer wavelengths due 
to the larger values of ro. The optimum gain in Strehl ra- 
tio over long exposures was found to be about a factor of 
6 at D/ro ~ 7. However, the Strehl gain is rather insen- 
sitive to D/ro with improvements of a factor of 4 or more 
being obtained over the full range of D/ro from 3 to 12. The 
improvements obtained by aligning frames without any se- 
lection (shift-and-add processing) are smaller, ranging from 
2 to 3. 

Frame selection has been found to improve image sharp- 
ness over a wide range of frame exposure times. Even with 
exposure times as long as 640ms the Strehl ratio was im- 
proved by a factor of 2. However the best gains in Strehl 
ratio (from 4 to 6) for the Siding Spring site are obtained 
with t < 10ms. The optimum exposure time may be longer 
for sites with better seeing or at longer wavelengths. 

Our results are consistent with previous lucky imaging 
studies, but explore a wider range of parameter space and 
show the potential for achieving larger Strehl ratios than 
previous results, which have generally been limited to Strehl 
ratios <0.3. The variation of Strehl ratio with D/ro we ob- 
serve s hows a similar form to, but lies below the simula- 
tions of [Baldwin et al.] (|2008l ). This is probably due to tele- 
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scope aberrations leading to a lower probability of achieving 
a lucky sharp image. 
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